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HOW  COMPENSATION  IN  TEST 
AND  EVALUATION  AFFEQS 
AIRCRAFT  ACQUISITION 


U  Co/  lionet  D.  AUord,  VW 

Systems  developers  and  testers  have  assumed  that  human  compensation  is 
measurable,  or  at  least  that  a  cognizant  and  trained  tester  is  able  to  identify 
and  detect  compensation.  More  than  one  study  conducted  at  the  Wright- 
Patterson  LAMARS  facility  indicates  that  this  is  not  necessarily  true.  Test  pilots 
were  able  to  compensate  sufficiently  to  fly  and  meet  defined  performance 
standards  on  intentionally  crippled  aircraft  flight  control  designs.  These  flight 
control  systems  were  designed  to  trigger  pilot  induced  oscillations,  but  in  most 
cases,  test  pilots  could  compensate  sufficiently  to  prevent  pilot  induced 
oscillations  and  to  control  the  simulated  aircraft.  Test  pilot  compensation  hides 
critical  handling  qualities  cliffs  that  can  lead  to  loss  of  an  aircraft  when 
encountered  by  less  skilled  pilots.  This  observation  has  vast  ramifications  for 
test,  evaluation,  and  development  of  all  human  interface  systems. 


After  solving  the  problems  of  pro- 
l  pulsion  and  lift,  the  control  of  an 
I  aircraft  was  the  third  and  possibly 
greatest  challenge  the  Wright  Brothers 
faced  in  conquering  the  air  (Figure  1). 
After  all,  the  Wright  Brothers  really  took 
eight  years  following  their  historic  first 
flight  to  determine  the  problem  of  stall  in 
a  turn  and  how  to  correct  it  (Culick,  2001). 
They  knew  how  to  control  the  aircraft, 
but  the  controls  were  insufficient.  The  air¬ 
craft  design,  power,  and  stability  were  all 
factors  in  solving  that  problem. 


Because  aircraft  design,  power,  and  sta¬ 
bility  all  affect  and  are  affected  by  the 
aircraft  control  system,  the  key  factor  in 
the  development  of  control  systems  for 
aircraft  is  to  design  them  to  optimize  the 
aircraft  performance  while  providing 
carefree  handling  qualities  to  the  pilot.  For 
example,  the  best  fuel  economy  is 
achieved  when  the  center  of  gravity  is 
behind  the  center  of  lift.  The  center  of  lift 
is  the  neutral  point  of  the  aircraft  and  hav¬ 
ing  the  center  of  gravity  at  or  behind  the 
center  of  lift  creates  a  condition  where 


DISCLAIMER 

The  views  expressed  in  this  article  are  those  of  the  author  and  do  not  necessarily  reflect  the  official 
policy  or  position  of  the  Air  Force,  the  Department  of  Defense,  or  the  U.S.  Government. 
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Figure  1.  The  Wright  brother's  first  fiight  was  stiii  eight  years 
away  from  a  fuiiy  stahie/centreiiahie  aircraft. 


the  aircraft  is  neutrally  stable  or  unstable 
—  both  bad  for  handling  qualities. 

An  aircraft  can  be  designed  with  an 
electronic  flight  control  system  that  gives 
the  pilot  a  positive,  stable,  handling-quali¬ 
ties  feel  while  the  aircraft  is  unstable  (Baer 
&  Landy,  1987).  This  design  results  in 
increased  fuel  economy,  a  characteristic 
of  the  Airbus  320-1-  and  the  Boeing  777. 
Future  airliners  will  certainly  capitalize 
and  expand  on  this  capability.  Another 
example  of  unstable  aircraft  design  to 
achieve  aircraft  requirements  is  found  in 
modern  fighter-type  aircraft.  For  radar 
stealth,  maneuvering  performance,  and 
mission  optimization,  among  other 
reasons,  the  exterior  of  military  aircraft 
are  designed  in  such  a  way  that,  without 
electronic  flight  controls,  they  would  be 
unflyable  (Rushby,  1993).  The  F-16,  F-18, 


F-22,  F-117,  and  B-2  are  all  examples 
of  this  type  of  design  (Rushby,  1993). 

The  problem  of  aircraft  handling  exists 
because  aircraft  controls  are  counter¬ 
intuitive.  Water  and  land-borne  transpor¬ 
tation  turn  using  a  device  like  a  rudder  to 
modify  the  velocity  vector  in  the  horizon¬ 
tal  plane.  This  is  an  intuitive  response  that 
is  easy  to  master.  To  turn  an  aircraft 
requires  a  roll  in  the  horizontal  plane 
coupled  with  a  pitch  rotation  to  counter 
loss  of  lift  in  the  vertical  plane  and  an 
increase  in  thrust  to  balance  the  increase 
in  drag.  The  pitch  rotation,  and  not  the  roll, 
turns  the  aircraft.  A  coordinated  turn  fur¬ 
ther  requires  a  corrective  yaw  rotation  in 
the  horizontal  plane  to  counter  the  slip 
induced  by  the  original  roll. 

Aircraft  motion  is  also  characterized  as 
a  mass-spring-damper  and  therefore  is  a 
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system  that  responds  in  a  manner  sig¬ 
nificantly  different  than  ground-hased 
controls.  The  problem  of  aircraft  control 
in  thrust  and  pitch  is  further  complicated 
hy  the  power  curve  response  in  the  region 
of  reverse  command  where  the  pitch 
control  largely  directs  airspeed  and  the 
thrust  directs  pitch  —  again  an  unintuitive 
response. 

People  can  generally  he  trained  to 
adequately  control  unintuitive  systems 
such  as  aircraft.  It  should  he  self-evident 
that  both  ground  and  flight  control  systems 
represent  natural  phenomena  that  are 
within  easy  grasp  of  human  beings. 
However,  higher-order  systems,  those 
greater  than  second  order,  are  not  gener¬ 
ally  found  in  nature  and  may  not  be 
predictable  by  human  beings  (National 
Research  Council,  1997;Rushby,  1993). 

Modern  digital  flight  control  systems 
use  approximations  of  mathematical  equa¬ 
tions  that  result  in  very  high  order  sys¬ 
tems  to  replicate  the  natural  response  of  a 
non-electronically  controlled  aircraft. 
These  systems  of  high-order  approxima¬ 
tions  generally  do  a  great  job  of  reproduc¬ 
ing  the  handling  qualities  of  the  perfect 
aircraft;  however,  they  result  in  a  system 
that  potentially  is  unpredictable  to  the 
operator  and  they  introduce  unpredictable 
response  in  the  overall  aircraft  system 
(National  Research  Council,  1997). 

The  problem  of  unpredictability  of  a 
flight  control  system  is  characterized  by 
handling  quality  cliffs  and  pilot  induced 
oscillation  (PIO).  A  handling  quality  cliff 
is  an  unknown  and  untested  area  in  a  flight 
control  envelope  where  it  is  possible  for 
the  pilot  to  unexpectedly  lose  control  of 
the  aircraft.  A  PIO  is  a  situation  where 
aircraft  response  lags  the  pilot’s  input  to 
the  controls.  The  pilot  unconsciously 


increases  control  input  such  that  each 
input  magnifies  the  aircraft  response  until 
loss  of  control  or  the  aircraft  comes  apart. 
PIO  is  not  unique  to  digital  flight  control 
systems,  but  unforeseen  PIOs  are.  These 
problems  are  best  characterized  by  the 
distinctive  mishaps  they  have  spawned. 

On  October  26,  1977,  the  prototype 
Space  Shuttle  was  launched  from  its  747 
carrier  aircraft.  The  pilots,  Fred  Haise  and 
Gordon  Fullerton,  at¬ 
tempted  a  spot  landing 
on  the  concrete  main 
runway  at  Edwards  Air 
Force  Base.  The  shuttle 
had  an  electronic  triply 
redundant  digital  fly-by- 
wire  flight  control  sys¬ 
tem.  The  expected  per¬ 
formance  of  the  aircraft 
did  not  match  the  actual 
performance  and  Haise 
found  himself  too  fast  on  the  approach. 
His  overcompensation  resulted  in  a  PIO 
in  roll  and  pitch.  In  spite  of  this,  he  landed 
the  shuttle  safely  (STS  Approach  and 
Landing  Test,  1977;  STS  Space  Shuttle, 
1977). 

NASA  engineers  found  a  270-millisec¬ 
ond  time  delay  in  the  flight  control  sys¬ 
tem  that  they  corrected  with  a  filter  (STS 
Space  Shuttle,  1977).  In  spite  of  this 
change,  the  pilot  astronauts  know  the 
shuttle  cannot  be  flown  like  a  fighter. 

The  flight  control  system  of  the 
shuttle  was  based  on  and  is  similar  to 
the  F-16.  The  F-16  had  and  has  a  known 
270-millisecond  time  delay  in  the  pitch 
axis.  If  the  aircraft  is  mishandled,  this 
delay  will  result  in  a  PIO,  and  PIO  has 
been  the  focus  of  numerous  mishap  in¬ 
vestigations  (Rushby,  1993).  The  result 
is  that  pilots  fly  an  F-16  approach  and 


"It  should  be  self- 
evident  that  both 
ground  and  flight 
controi  systems 
represent  naturai 
phenomena  that 
are  within  easy 
grasp  of  human 
beings." 
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landing  like  they  would  a  heavy  aircraft 
and  not  like  a  fighter. 

Usually,  critical  PIO  problems  are  only 
identified  as  a  problem  when  they  cause 
an  aircraft  mishap.  On  February  2,  1987 
during  its  seventh  flight,  the  first  prototype 
Swedish  Saab  JAS39  Gripen  crashed  on 
landing.  The  Gripen  had  a  triplex  redundant 
fly-by-wire  digital  control  system  backed 
up  by  a  triplex  redundant  analogue  fly¬ 
by-wire  control  system.  The  first  test  pilot 
remarked  that  the  flight  control  system  was 
too  sensitive  and  displayed  problems  with 
lateral  and  pitch  oscillations.  The  pilot  fly¬ 
ing  during  the  mishap  had  never  flown  the 
Gripen,  and  gusty  wind  conditions  likely 
exacerbated  the  problems  with  lateral  and 
pitch  oscillations.  The  pilot  encountered 
increasing  PIOs  characterized  by  dynamic 
pitch  instability  during  approach.  These 
control  problems  resulted  in  the  aircraft 


striking  a  wing  on  landing  and  the  destruc¬ 
tion  of  the  aircraft  (Aviation  Week,  1989; 
Flight  International,  1989;  Nutley,  1989; 
Pellebergs,  1991). 

The  Gripen  program  went  through  a  very 
intensive  flight  and  ground  test  program 
to  fix  the  problems  caused  by  the  flight 
control  system,  and  the  aircraft  continued 
development.  Everything  appeared  fine 
until  on  August  8,  1993,  during  a  normal 
maneuver,  a  pilot  flying  the  Gripen  in  an 
airshow  fully  saturated  the  flight  controls 
and  entered  an  unrecoverable  PIO.  The 
manufacturer  and  the  customer  knew  that 
large  stick  movements  could  saturate  the 
flight  control  system,  but  the  pilot  was  un¬ 
aware  of  this  aircraft  characteristic.  The 
aircraft  was  destroyed  (Swedish  Accident 
Investigation,  1993). 

The  Gripen  is  not  the  only  aircraft  that 
has  experienced  interaction  of  the  pilot 


Figure  2.  The  latest  F-22  less  of  control  incident  is 
possibly  a  digital  flight  control  cliff. 
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and  the  flight  control  system  that  re¬ 
sulted  in  the  loss  of  a  prototype  aircraft. 
On  April  25,  1992,  the  YF-22  (the  pro¬ 
duction  F-22  is  shown  in  Figure  2)  also 
crashed  during  landing  due  to  PIO 
caused  hy  the  fly-hy-wire  system 
(Rushhy,  1993). 

Although  PIO  is  a  known  problem 
of  non-fly-hy-wire  flight  control  sys¬ 
tems,  time  delays,  handling  qualities 
cliffs,  unpredictable  flight  characteris¬ 
tics,  saturated  control  systems,  the  at¬ 
tendant  PIOs,  and  loss  of  control  are 
characteristics  of  fly-by-wire  flight  con¬ 
trol  systems.  One  final  example  will  il¬ 
luminate  this  problem  of  PIOs  as  it  re¬ 
lates  to  testing.  Many  of  these  control 
problems  manifest  themselves  in  the  roll 
axis.  In  heavy  aircraft,  the  problems 
result  in  a  faster  roll  rate  than  normally 
expected  (Norton,  1994).  This 
unpredictability,  combined  with  trans¬ 
port  delays  cause  PIOs.  The  C-17  pro¬ 
gram  encountered  this  problem  late  in 
its  test  program.  The  aircraft  had  a 
known  quick  roll  rate,  but  test  pilots 
who  had  been  flying  the  aircraft  for  a 
while  did  not  consider  it  a  problem. 
New  test  pilots  generally  complained 
about  the  roll  rate  and  its  attendant  PIO 
during  landing  approach,  but  they 
quickly  learned  to  compensate.  When 
a  test  pilot  new  to  the  C-17  recognized 
the  problem  and  complained  offi¬ 
cially,  the  program  blamed  the  pilot 
and  continued  with  the  control  system 
unchanged.  In  Operational  Test  & 
Evaluation  (OT&E),  the  operational 
pilots  reported  the  problem  as  an  air¬ 
craft  deficiency  and  that  is  when  it  was 
finally  fixed. 

The  difficulty  in  the  C-17  program 
wasn’t  simply  that  a  handling  qualities 


problem  existed  in  the  roll  axis.  The 
problem  was  that  so  many  trained  test 
pilots,  military  and  civilian,  had  flown 
an  aircraft  with  an  obvious  deficiency 
and  found  it  acceptable  without  changes. 
The  factor  of  aptitude  that  allows  trained 
test  pilots  to  compensate  for  evident  de¬ 
ficiencies  in  flight  control  system  is  the 
problem  this  paper  directly  addresses. 


The  Experiment 


The  above  situations  demonstrate  that 
PIOs  in  fly-by-wire  aircraft  are  neither 
uncommon  nor  insignificant,  and  they 
are  more  likely  to  be  experienced  by  non¬ 
test  pilot  aviators.  At  best,  they  represent 
a  nuisance  and,  at  worst,  a  potentially 
catastrophic  air  event.  Because  of  these 
problems,  their  criticality  to  flight  and 
the  danger  of  not  finding  them  during 
developmental  testing,  we  are  studying 
PIOs,  when  possible,  through  simula¬ 
tions. 

In  December  1998,  I  participated  as  a 
subject  in  the  HAVE 
EIMITS  SIM  and  HAVE 
PIO  SIM,  PIO  study  con¬ 
ducted  by  the  Air  Eorce 
Research  Eaboratory 
Air  Vehicle  Directorate 
(AERE/VA)  that  used 
the  Earge  Amplitude 
Multi-Mode  Aerospace 
Research  Simulator 
(EAMARS).  EAMARS 
is  a  20-foot  diameter 
sphere  on  the  end  of  a 
30-foot  beam  that  com¬ 
prises  a  5-Degree  of  Ereedom  Simulator 
(Eigure  3).  The  simulator  includes  a 
McEadden  Eeel  System,  wrap-around 


"The  lacier  of 
aptitude  that 
allows  trained 
lest  pilots  to 
compensate  for 
evident  deficien¬ 
cies  in  flight 
control  system  is 
the  prehlem  this 
paper  directly 
addresses." 
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Figure  3.  The  LAMARS  simulator 


Error 


Figure  4.  The  heads-up  display  during  the  LAMARS  lest 
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visuals,  and  a  Heads-Up  Display  (HUD) 
(Figure  4).  The  UAMARS  system  is 
capable  of  up  to  -2  to  -h3  g  vertical  and 
-3  to  -1-3  g  horizontal  acceleration. 

The  purpose  of  the  experiment  was 
to  gather  data  on  aircraft  handling  quali¬ 
ties  models  (good,  bad,  and  ugly)  to 
correlate  in-flight  variable  simulation 
data  from  the  original  HAVE  LIMITS 
and  HAVE  PIO  open  air  programs  with 
simulation  data.  The  experiment  fea¬ 
tured  three  pitch  and  roll  capture  tasks 
with  increasing  levels  of  workload  and 
a  landing  task.  The  aircraft  handling 
qualities  models  varied  widely  based  on 
18  variations  tested  previously  in  the 
CALSPANA/eridian  NT-33  variable  sta¬ 
bility  aircraft.  The  study  itself  resulted 
in  good  data  but  simulation  results 
could  not  be  correlated  with  open-air 
flight  test  (Stadler,  1999).  The  obser¬ 
vations  I  made  came  out  of  a  deviation 
from  the  test  and  were  not  included  di¬ 
rectly  in  the  test  or  research. 

I  had  the  opportunity  to  be  the  first  of 
three  test  pilots  who  participated  in  the 
program.  When  I  arrived  to  make  the  first 
runs,  the  LAMARS  was  not  ready  for 
motion.  I  flew  a  full  set  of  the  simulations 
as  training  without  simulator  motion.  A 
few  days  later,  I  flew  the  remaining  train¬ 
ing  and  data  runs  with  LAMARS  accel¬ 
erative  motion.  My  observations  come 
from  the  unique  perspective  of  being  able 
to  see  how  the  simulations  flew  with  and 
without  accelerative  motion. 

When  the  motion  was  off,  some  of 
the  configurations  were  impossible  to 
fly.  Many  of  the  flight  control  designs 
were  divergent  and  resulted  in  complete 
loss  of  control.  The  simulator  was  rela¬ 
tively  easy  to  PIO  and  many  of  the  runs 


resulted  in  a  departure  from  controlled 
flight.  In  most  cases,  the  pilot  could  not 
respond  quickly  enough  to  go  open 
loop  when  a  PIO  was  immanent.  Lur- 
ther,  as  reason  might  indicate,  the  higher 
the  workload  of  the  task  the  easier  it 
was  to  depart  the  system.  This  was  not 
true  during  the  simulation  runs  with  ac¬ 
celerative  motion. 

When  accelerative  motion  was  on,  the 
tasks  became  easier  to  fly  as  the  workload 
increased.  Pilot  compensation  and  learn¬ 
ing  occurred  at  a  rate  not  possible  with¬ 
out  motion.  Due  to  the  natural  feel  in  the 
acceleration,  it  was  increasingly  easy  with 
increasing  workload  to 
maintain  control  of  the 
aircraft.  The  pilot  had  to 
force  himself  to  allow 
PIO  conditions  to  con¬ 
tinue.  It  was  very  easy 
to  reduce  workload 
slightly  and  allow  the 
system  to  dampen  out 
instead  of  pulling  ag¬ 
gressively  to  the  point  that  would  have 
departed  the  system.  This  was  very  ob¬ 
vious  with  negative  G  during  pushovers. 
Although,  the  simulations  felt  like  they 
were  often  on  the  ragged  edge  of  de¬ 
parture,  it  was  possible  to  prevent  a  PIO 
and  a  departure.  The  feedback  I  re¬ 
ceived  was  that  the  departure  rate  over¬ 
all  during  the  study  was  lower  than  ex¬ 
pected,  “the  bad  was  not  as  bad”  as 
seen  in  the  actual  aircraft  (Stadler, 
1999).  Additionally,  the  researchers  ob¬ 
served  that  pilot  anticipation  of  the  PIOs 
may  have  skewed  the  data. 

It  would  be  easy  at  this  point  to  con¬ 
clude  that  the  study  itself  did  not  pro¬ 
vide  much  useful  data,  but  I  think  this 


"When 
accelerative 
motion  was  on,  the 
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program  highlighted  a  very  critical  area 
that  has  not  been  considered  much  in  flight 
testing  —  test  pilots  may  not  he  able  to 
gauge  how  much  they  are  compensating. 

Results 


The  observation  that  test  pilots  may  not 
be  able  to  gauge  how  much  they  are  com¬ 
pensating  is  not  as  obvious  as  it  seems.  We 
expect  average  pilot  subjects  to  not  know 
they  are  compensating  — 
we  assume  they  are 
compensating  and  we 
assume  we  can  mea¬ 
sure  that  compensation 
through  workload.  For 
test  pilots  the  situation  is 
different.  A  key  skill  in 
which  we  train  test  pi¬ 
lots  is  to  observe  and 
know  when  they  are 
compensating.  This  is  the  proverbial  test  pilot 
handshake.  If  test  pilots  cannot  gauge  their 
compensation,  then  there  is  little  hope  of 
solving  the  critical  problems  that  face  us  in 
digital  flight  control  systems.  Indeed,  based 
on  this  observation,  we  may  have  to  look 
for  a  different  way  of  designing  and  testing 
not  just  flight  control  systems  but  aU  types 
of  human-machine  interfaces. 

As  long  as  the  aircraft  is  predictable,  and 
predictability  increases  dramatically  with 
natural  accelerative  motion,  the  pilot  can 
apply  reflexive  filtering  that  normally  pre¬ 
vents  PIO  and  departure.  As  my  experi¬ 
ence  in  the  simulator  with  and  without  ac¬ 
celerative  motion  demonstrates,  without 
accelerative  motion,  the  system  is  not  as 
predictable  as  with  accelerative  motion. 
Without  G  force,  the  system  is  less  pre¬ 
dictable.  The  aircraft’s  acceleration  makes 


possible  heroic  response  to  bad  flight  control 
systems. 

I  assert  heroic  response  with  intended  ex¬ 
perimental  precision.  Heroic  response  is  ex¬ 
actly  what  any  pilot  accomplishes  when 
faced  with  a  poor  flight  control  system  de¬ 
sign.  Experienced  pilots  unconsciously  feel 
the  natural/predictable  modes  of  an  aircraft 
and  successfully  compensate  for  poor  han¬ 
dling  qualities.  Most  pilots  do  not  realize 
the  degree  of  compensation  used  to  coun¬ 
teract  normal  aircraft  handling  qualities. 

In  an  aircraft  development  program,  as 
an  aircraft  flight  control  system  improves, 
the  test  pilot’s  compensation  improves  and 
without  a  significant  event,  such  as  a 
recalibration  of  the  pilot’s  compensation  ex¬ 
perience,  the  compensation  will  continue 
to  improve.  As  with  the  C-17  example,  and 
much  of  my  flight  test  experience  shows, 
test  pilots,  like  all  pilots,  will  at  some  point 
no  longer  be  able  to  gauge  their  compensa¬ 
tion  and  then  they  will  not  be  of  much  use 
to  the  test  program.  Without  training  or  com¬ 
parisons,  it  may  be  impossible  for  pilots  to 
gauge  the  degree  of  compensation,  espe¬ 
cially  with  long-term  programs  and  pro¬ 
grams  where  handling  qualities  have  im¬ 
proved  gradually  over  time. 

This  observation  is  hue  of  flight  control 
systems  as  well  as  any  other  control  system 
in  an  aircraft.  I  further  suspect  that  this  ob¬ 
servation  concerning  compensation  and  test 
pilots  is  true  of  tests  in  all  other  complex 
systems. 

In  the  case  of  unnatural  or  unpredictable 
modes  of  digital  flight  control  aircraft,  these 
modes  can  only  be  learned  through  experi¬ 
ence  —  if  undiscovered  and  uncorrected, 
these  handling  qualities  cliffs  will  result  in 
loss  of  aircraft.  These  characteristics  of  pi¬ 
lot  compensation  make  digital  flight  con¬ 
trol  aircraft  more  difScrrlt  to  sufficiently  test. 


"Acquiring 
firms  consider 
both  distressed 
and  highiy 
prefilabie  firms 
as  pelenliai 
acquisition 
candidates." 
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Pilots  may  learn  to  compensate  to  the  de¬ 
gree  that  they  unconsciously  filter  even  un¬ 
natural  and  unpredictable  modes.  However, 
if  the  mode  is  not  experienced,  is  unpre¬ 
dictable,  or  is  not  discovered  and  corrected 
during  testing,  some  operational  pilot  will 
eventually  encounter  a  handlings  quality 
cliff,  and  recovery  may  not  be  possible. 

Recommendations 


1.  More  research  needs  to  be  accom¬ 
plished  on  measuring  pilot  compensa¬ 
tion  —  and  workload  may  not  be  a 
good  measure.  Workload  measurement 
has  been  the  Holy  Grail  of  human  fac¬ 
tors  testing.  To  date  we  do  not  have  a 
quantitative  measure  of  workload  and 
this  makes  human  factors  testing  sub¬ 
jective  and  difficult.  Quantitative 
workload  measurement  is  a  needed  and 
necessary  tool  for  human-machine  in¬ 
terface  development,  but  there  is  a  piece 
of  the  puzzle  that  is  still  missing  in 
workload  measurement  —  how  do  we 
quantify  compensation? 

2.  Test  pilots  require  hands-on  training  to 
understand  the  level  of  compensation 
possible  during  test  programs.  The 
LAMARS  facility  with  its  PIO  models 
provides  an  excellent  means  of  train¬ 
ing.  This  training  should  be  required  in 
every  Test  Pilot  School  curriculum  and 
taught  as  continuing  Test  Pilot  educa¬ 
tion.  Prior  to  the  test  of  digital  flight  con¬ 
trol  system  aircraft,  the  pilots  on  the 
program  should  attend  some  level  of 
refresher  orientation.  The  training 
should  allow  the  comparison  between 
seat-of-the-pants  accelerative  motion 
and  no-motion  to  drive  home  the  point 


that  too  much  exposure  to  bad  flight 
control  models  skews  the  pilot’s  per¬ 
spective,  and  a  pilot  can  become  too 
comfortable  with  a  poor  flying  system. 

3.  Test  pilots  need  to  constantly  recalibrate 
their  awareness  of  aircraft  handling 
quality  differences  and  compensation. 
The  best  way  to  achieve  this  is  through 
multiple  qualifications  and  qualification 
flights  in  different  aircraft.  All  programs 
could  benefit  from  this  regimen.  Test 
pilots  who  don’t  fly  multiple  aircraft  and 
who  cannot  compare  different  designs 
and  systems  lose  the  ability  to  identify 
their  level  of  compensation.  The  best 
method  to  keeping  this  critical  skill 
sharp  is  to  experience  known  deficient 
designs  and  poor  handling  aircraft.  Test 
pilot  schools  and  test  centers  should  en¬ 
sure  a  large  number  of  poor  aircraft  and 
historical  aircraft  are  available  for  test 
pilot  qualification.  The  services  should 
address  this  problem  by  allowing  test 
pilot  access  to  more  systems. 

4.  An  obvious  but  often  overlooked 
recommendation  in  the  analysis  of  fly- 
by-wire  systems  is  that  developers 
should  attempt  to  design  predictable 
flight  models  that  don’t  just  mimic  natu¬ 
ral  aircraft  response  but  truly  match  it. 

Conclusion 


We  may  have  underestimated  the  role  of 
compensation  in  testing  and  we  need  to  de¬ 
termine  ways  to  measure  compensation. 
Pilots  can  learn  to  adequately  fly  poor  air¬ 
craft  with  intentionally  poor  handling  quali¬ 
ties.  They  appear  to  be  able  to  unconsciously 
filter  certain  characteristics  in  the  handling 
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qualities  envelope  of  the  aircraft.  Unfortu¬ 
nately,  systems  developers  and  testers  have 
always  assumed  that  human  compensa¬ 
tion  is  measurable,  or  at  least  that  a  cogni¬ 
zant  and  trained  tester  is  able  to  identify 
and  detect  compensation.  The  HAVE  LIM¬ 
ITS  SIM  and  HAVE  PIO  SIM  studies  con¬ 
ducted  at  the  Wright-Patterson  LAMARS 
facility  indicate  that  this  is  not  necessarily 
true.  Test  pilots  were  able  to  compensate 
sufficiently  to  fly  and  meet  defined  per¬ 
formance  standards  on  intentionally 
crippled  aircraft  flight  control  designs.  This 
creates  critical  questions  for  the  testing  of 
future  human  interface  system.  To  help 
solve  these  problems: 

•  More  research  needs  to  be  accom¬ 
plished  on  measuring  pilot  compensa¬ 
tion. 

•  Test  pilots  require  hands-on  training  to 
understand  the  level  of  compensation 
possible  during  test  programs. 


•  Test  pilots  need  to  constantly  recalibrate 
their  awareness  of  aircraft  handling 
quality  differences  and  compensation. 

•  Developers  should  attempt  to  design 
predictable  flight  models  that  don’t  just 
mimic  natural  aircraft  response  but  truly 
match  it. 

Digital  control  systems  create  unique 
problems  for  engineering  design  and  flight. 
In  the  case  of  aircraft,  the  best  design  ap¬ 
proach  may  be  to  develop  predictable  flight 
models  that  directly  match  or  simply  aug¬ 
ment  natural  aircraft  response  instead  of 
using  complex  digital  equations  that  imi¬ 
tate  assumed  aircraft  response.  Until  that 
point  is  reached  and  because  of  the  diffi¬ 
culties  involved  in  designing  human  inter¬ 
faces  and  the  human  control  of  complex 
systems,  we  must  find  quantitative  ways 
to  measure  compensation  and  we  must 
control  experiments  to  address  compen¬ 
sation  issues. 
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